Pandas Profiling Report

Dataset statistics

Number of variables	29
Number of observations	91796
Missing cells	0
Missing cells (%)	0.0%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	20.3 MiB
Average record size in memory	232.0 B

Variable types

CAT	14
NUM	13
BOOL	2

Warnings

`crash_date` has a high cardinality: 492 distinct values	High cardinality
`crash_time` has a high cardinality: 1440 distinct values	High cardinality
`zip_code` has a high cardinality: 204 distinct values	High cardinality
`location` has a high cardinality: 44604 distinct values	High cardinality
`on_street_name` has a high cardinality: 3692 distinct values	High cardinality
`contributing_factor_vehicle_1` has a high cardinality: 54 distinct values	High cardinality
`number_of_motorist_injured` is highly correlated with `number_of_persons_injured` and 1 other fields	High correlation
`number_of_persons_injured` is highly correlated with `number_of_motorist_injured` and 1 other fields	High correlation
`year` is highly correlated with `collision_id`	High correlation
`collision_id` is highly correlated with `year`	High correlation
`victim` is highly correlated with `number_of_persons_injured` and 1 other fields	High correlation
`number_of_motorist_killed` is highly correlated with `number_of_persons_killed`	High correlation
`number_of_persons_killed` is highly correlated with `number_of_motorist_killed`	High correlation
`longitude` is highly skewed (γ1 = -149.3269464)	Skewed
`collision_id` has unique values	Unique
`number_of_persons_injured` has 66819 (72.8%) zeros	Zeros
`number_of_pedestrians_injured` has 87467 (95.3%) zeros	Zeros
`number_of_motorist_injured` has 75522 (82.3%) zeros	Zeros
`vehicle_type_code1_num` has 42899 (46.7%) zeros	Zeros
`vehicle_type_code2_num` has 32950 (35.9%) zeros	Zeros
`hour` has 3788 (4.1%) zeros	Zeros
`victim` has 66699 (72.7%) zeros	Zeros

Reproduction

Analysis started	2020-12-11 09:16:19.909233
Analysis finished	2020-12-11 09:16:50.063289
Duration	30.15 seconds
Software version	pandas-profiling v2.9.0
Download configuration	config.yaml

collision_id
Real number (ℝ_≥0)

HIGH CORRELATION
UNIQUE

Distinct	91796
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	4225941.687
Minimum	225766
Maximum	4353706
Zeros	0
Zeros (%)	0.0%
Memory size	717.2 KiB

Quantile statistics

Minimum	225766
5-th percentile	3665120.5
Q1	4182167.75
median	4300433.5
Q3	4328281.25
95-th percentile	4348298.25
Maximum	4353706
Range	4127940
Interquartile range (IQR)	146113.5

Descriptive statistics

Standard deviation	161127.838
Coefficient of variation (CV)	0.03812826819
Kurtosis	10.94913254
Mean	4225941.687
Median Absolute Deviation (MAD)	51708
Skewness	-2.728466752
Sum	3.879245431e+11
Variance	2.596218018e+10
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
4327423	1	< 0.1%
4322057	1	< 0.1%
4342301	1	< 0.1%
4348446	1	< 0.1%
4346399	1	< 0.1%
4303392	1	< 0.1%
4170273	1	< 0.1%
4307490	1	< 0.1%
4174371	1	< 0.1%
4162085	1	< 0.1%
Other values (91786)	91786	> 99.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
225766	1	< 0.1%
2809808	1	< 0.1%
2874775	1	< 0.1%
2879367	1	< 0.1%
2912981	1	< 0.1%

Value	Count	Frequency (%)
4353706	1	< 0.1%
4353705	1	< 0.1%
4353672	1	< 0.1%
4353663	1	< 0.1%
4353660	1	< 0.1%

crash_date
Categorical

HIGH CARDINALITY

Distinct	492
Distinct (%)	0.5%
Missing	0
Missing (%)	0.0%
Memory size	717.2 KiB

2019-07-16	619
2019-07-19	614
2019-08-08	604
2019-07-29	600
2019-07-26	593
Other values (487)	88766

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
2019-07-16	619	0.7%
2019-07-19	614	0.7%
2019-08-08	604	0.7%
2019-07-29	600	0.7%
2019-07-26	593	0.6%
2019-07-15	593	0.6%
2019-09-03	591	0.6%
2019-07-22	588	0.6%
2019-07-30	584	0.6%
2019-07-18	582	0.6%
Other values (482)	85828	93.5%

Frequencies of value counts

Unique

Unique	102 ?
Unique (%)	0.1%

Histogram of lengths of the category

Length

Max length	10
Median length	10
Mean length	10
Min length	10

crash_time
Categorical

HIGH CARDINALITY

Distinct	1440
Distinct (%)	1.6%
Missing	0
Missing (%)	0.0%
Memory size	717.2 KiB

0:00	1494
17:00	1253
16:00	1251
14:00	1212
18:00	1145
Other values (1435)	85441

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
0:00	1494	1.6%
17:00	1253	1.4%
16:00	1251	1.4%
14:00	1212	1.3%
18:00	1145	1.2%
15:00	1132	1.2%
13:00	1086	1.2%
12:00	1039	1.1%
19:00	935	1.0%
9:00	895	1.0%
Other values (1430)	80354	87.5%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	5
Median length	5
Mean length	4.745348381
Min length	4

borough
Categorical

Distinct	6
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	717.2 KiB

BROOKLYN	27388
QUEENS	22282
BRONX	14475
MANHATTAN	13866
Unspecified	11354

Frequencies
Length

Value	Count	Frequency (%)
BROOKLYN	27388	29.8%
QUEENS	22282	24.3%
BRONX	14475	15.8%
MANHATTAN	13866	15.1%
Unspecified	11354	12.4%
STATEN ISLAND	2431	2.6%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	13
Median length	8
Mean length	7.695999826
Min length	5

zip_code
Categorical

HIGH CARDINALITY

Distinct	204
Distinct (%)	0.2%
Missing	0
Missing (%)	0.0%
Memory size	717.2 KiB

Unspecified	11357
11207.0	1939
11236.0	1333
11208.0	1300
11212.0	1263
Other values (199)	74604

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
Unspecified	11357	12.4%
11207.0	1939	2.1%
11236.0	1333	1.5%
11208.0	1300	1.4%
11212.0	1263	1.4%
11385.0	1207	1.3%
11203.0	1189	1.3%
11434.0	1132	1.2%
11226.0	1077	1.2%
11234.0	1069	1.2%
Other values (194)	68930	75.1%

Frequencies of value counts

Unique

Unique	9 ?
Unique (%)	< 0.1%

Histogram of lengths of the category

Length

Max length	11
Median length	7
Mean length	7.494879951
Min length	7

latitude
Real number (ℝ_≥0)

Distinct	33674
Distinct (%)	36.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	40.72675874
Minimum	40.501465
Maximum	40.91217
Zeros	0
Zeros (%)	0.0%
Memory size	717.2 KiB

Quantile statistics

Minimum	40.501465
5-th percentile	40.60102875
Q1	40.668167
median	40.717926
Q3	40.785854
95-th percentile	40.86434525
Maximum	40.91217
Range	0.410705
Interquartile range (IQR)	0.117687

Descriptive statistics

Standard deviation	0.08082751098
Coefficient of variation (CV)	0.001984629111
Kurtosis	-0.7352348647
Mean	40.72675874
Median Absolute Deviation (MAD)	0.052966
Skewness	0.1662156864
Sum	3738553.545
Variance	0.006533086532
Monotocity	Increasing

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
40.861862	79	0.1%
40.8047	56	0.1%
40.820305	52	0.1%
40.696033	48	0.1%
40.675735	48	0.1%
40.658577	47	0.1%
40.737785	45	< 0.1%
40.651863	43	< 0.1%
40.65965	42	< 0.1%
40.733536	41	< 0.1%
Other values (33664)	91295	99.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
40.501465	1	< 0.1%
40.50331	1	< 0.1%
40.503387	1	< 0.1%
40.503414	1	< 0.1%
40.50447	1	< 0.1%

Value	Count	Frequency (%)
40.91217	1	< 0.1%
40.912117	1	< 0.1%
40.912018	1	< 0.1%
40.91038	1	< 0.1%
40.91032	2	< 0.1%

longitude
Real number (ℝ)

SKEWED

Distinct	26493
Distinct (%)	28.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	-73.91783051
Minimum	-201.23706
Maximum	-73.700584
Zeros	0
Zeros (%)	0.0%
Memory size	717.2 KiB

Quantile statistics

Minimum	-201.23706
5-th percentile	-74.0157625
Q1	-73.96098
median	-73.918304
Q3	-73.86333875
95-th percentile	-73.76194875
Maximum	-73.700584
Range	127.536476
Interquartile range (IQR)	0.09764125

Descriptive statistics

Standard deviation	0.8444969603
Coefficient of variation (CV)	-0.01142480717
Kurtosis	22511.0176
Mean	-73.91783051
Median Absolute Deviation (MAD)	0.048179
Skewness	-149.3269464
Sum	-6785361.169
Variance	0.7131751159
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
-73.91282	83	0.1%
-73.89063	73	0.1%
-73.91243	61	0.1%
-73.89083	58	0.1%
-73.89686	53	0.1%
-73.98453	52	0.1%
-73.93755	47	0.1%
-73.86536	46	0.1%
-73.96191	46	0.1%
-73.882744	46	0.1%
Other values (26483)	91231	99.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
-201.23706	4	< 0.1%
-74.253006	1	< 0.1%
-74.250824	1	< 0.1%
-74.25076	1	< 0.1%
-74.25015	1	< 0.1%

Value	Count	Frequency (%)
-73.700584	1	< 0.1%
-73.70073	1	< 0.1%
-73.70099	1	< 0.1%
-73.701004	1	< 0.1%
-73.70129	1	< 0.1%

location
Categorical

HIGH CARDINALITY

Distinct	44604
Distinct (%)	48.6%
Missing	0
Missing (%)	0.0%
Memory size	717.2 KiB

(40.861862, -73.91282)	79
(40.8047, -73.91243)	55
(40.820305, -73.89083)	52
(40.696033, -73.98453)	48
(40.675735, -73.89686)	48
Other values (44599)	91514

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
(40.861862, -73.91282)	79	0.1%
(40.8047, -73.91243)	55	0.1%
(40.820305, -73.89083)	52	0.1%
(40.696033, -73.98453)	48	0.1%
(40.675735, -73.89686)	48	0.1%
(40.658577, -73.89063)	47	0.1%
(40.737785, -73.93496)	43	< 0.1%
(40.733536, -73.87035)	41	< 0.1%
(40.66496, -73.82226)	40	< 0.1%
(40.60567, -74.030945)	39	< 0.1%
Other values (44594)	91304	99.5%

Frequencies of value counts

Unique

Unique	29003 ?
Unique (%)	31.6%

Histogram of lengths of the category

Length

Max length	25
Median length	22
Mean length	21.73174212
Min length	17

on_street_name
Categorical

HIGH CARDINALITY

Distinct	3692
Distinct (%)	4.0%
Missing	0
Missing (%)	0.0%
Memory size	717.2 KiB

Unspecified	25128
BELT PARKWAY	1455
LONG ISLAND EXPRESSWAY	1000
BROOKLYN QUEENS EXPRESSWAY	889
BROADWAY	843
Other values (3687)	62481

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
Unspecified	25128	27.4%
BELT PARKWAY	1455	1.6%
LONG ISLAND EXPRESSWAY	1000	1.1%
BROOKLYN QUEENS EXPRESSWAY	889	1.0%
BROADWAY	843	0.9%
GRAND CENTRAL PKWY	797	0.9%
FDR DRIVE	797	0.9%
ATLANTIC AVENUE	690	0.8%
MAJOR DEEGAN EXPRESSWAY	635	0.7%
CROSS BRONX EXPY	624	0.7%
Other values (3682)	58938	64.2%

Frequencies of value counts

Unique

Unique	907 ?
Unique (%)	1.0%

Histogram of lengths of the category

Length

Max length	32
Median length	12
Mean length	13.3261689
Min length	6

number_of_persons_injured
Real number (ℝ_≥0)

HIGH CORRELATION
ZEROS

Distinct	13
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.3685672578
Minimum	0
Maximum	15
Zeros	66819
Zeros (%)	72.8%
Memory size	717.2 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	1
95-th percentile	2
Maximum	15
Range	15
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	0.7379089761
Coefficient of variation (CV)	2.002101273
Kurtosis	17.05818929
Mean	0.3685672578
Median Absolute Deviation (MAD)	0
Skewness	3.168145535
Sum	33833
Variance	0.544509657
Monotocity	Not monotonic

Histogram with fixed size bins (bins=13)

Value	Count	Frequency (%)
0	66819	72.8%
1	19345	21.1%
2	3689	4.0%
3	1180	1.3%
4	469	0.5%
5	172	0.2%
6	68	0.1%
7	31	< 0.1%
8	12	< 0.1%
9	5	< 0.1%
Other values (3)	6	< 0.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	66819	72.8%
1	19345	21.1%
2	3689	4.0%
3	1180	1.3%
4	469	0.5%

Value	Count	Frequency (%)
15	1	< 0.1%
11	3	< 0.1%
10	2	< 0.1%
9	5	< 0.1%
8	12	< 0.1%

number_of_persons_killed
Categorical

HIGH CORRELATION

Distinct	4
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	717.2 KiB

0	91630
1	160
2	5
3	1

Frequencies
Length

Value	Count	Frequency (%)
0	91630	99.8%
1	160	0.2%
2	5	< 0.1%
3	1	< 0.1%

Frequencies of value counts

Unique

Unique	1 ?
Unique (%)	< 0.1%

Histogram of lengths of the category

Length

Max length	1
Median length	1
Mean length	1
Min length	1

number_of_pedestrians_injured
Real number (ℝ_≥0)

ZEROS

Distinct	6
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.0491415748
Minimum	0
Maximum	6
Zeros	87467
Zeros (%)	95.3%
Memory size	717.2 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0
95-th percentile	0
Maximum	6
Range	6
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	0.2272210757
Coefficient of variation (CV)	4.623805335
Kurtosis	36.85800898
Mean	0.0491415748
Median Absolute Deviation (MAD)	0
Skewness	5.157088489
Sum	4511
Variance	0.05162941725
Monotocity	Not monotonic

Histogram with fixed size bins (bins=6)

Value	Count	Frequency (%)
0	87467	95.3%
1	4175	4.5%
2	134	0.1%
3	17	< 0.1%
6	2	< 0.1%
5	1	< 0.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	87467	95.3%
1	4175	4.5%
2	134	0.1%
3	17	< 0.1%
5	1	< 0.1%

Value	Count	Frequency (%)
6	2	< 0.1%
5	1	< 0.1%
3	17	< 0.1%
2	134	0.1%
1	4175	4.5%

number_of_pedestrians_killed
Boolean

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	717.2 KiB

0	91737
1	59

Common Values
Chart

Value	Count	Frequency (%)
0	91737	99.9%
1	59	0.1%

number_of_cyclist_injured
Categorical

Distinct	4
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	717.2 KiB

0	87231
1	4470
2	94
3	1

Frequencies
Length

Value	Count	Frequency (%)
0	87231	95.0%
1	4470	4.9%
2	94	0.1%
3	1	< 0.1%

Frequencies of value counts

Unique

Unique	1 ?
Unique (%)	< 0.1%

Histogram of lengths of the category

Length

Max length	1
Median length	1
Mean length	1
Min length	1

number_of_cyclist_killed
Boolean

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	717.2 KiB

0	91776
1	20

Common Values
Chart

Value	Count	Frequency (%)
0	91776	> 99.9%
1	20	< 0.1%

number_of_motorist_injured
Real number (ℝ_≥0)

HIGH CORRELATION
ZEROS

Distinct	13
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.2686718376
Minimum	0
Maximum	15
Zeros	75522
Zeros (%)	82.3%
Memory size	717.2 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0
95-th percentile	2
Maximum	15
Range	15
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	0.7034711697
Coefficient of variation (CV)	2.61832865
Kurtosis	22.65571798
Mean	0.2686718376
Median Absolute Deviation (MAD)	0
Skewness	3.879183065
Sum	24663
Variance	0.4948716866
Monotocity	Not monotonic

Histogram with fixed size bins (bins=13)

Value	Count	Frequency (%)
0	75522	82.3%
1	11021	12.0%
2	3367	3.7%
3	1135	1.2%
4	468	0.5%
5	167	0.2%
6	64	0.1%
7	29	< 0.1%
8	12	< 0.1%
9	5	< 0.1%
Other values (3)	6	< 0.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	75522	82.3%
1	11021	12.0%
2	3367	3.7%
3	1135	1.2%
4	468	0.5%

Value	Count	Frequency (%)
15	1	< 0.1%
11	3	< 0.1%
10	2	< 0.1%
9	5	< 0.1%
8	12	< 0.1%

number_of_motorist_killed
Categorical

HIGH CORRELATION

Distinct	4
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	717.2 KiB

0	91709
1	81
2	5
3	1

Frequencies
Length

Value	Count	Frequency (%)
0	91709	99.9%
1	81	0.1%
2	5	< 0.1%
3	1	< 0.1%

Frequencies of value counts

Unique

Unique	1 ?
Unique (%)	< 0.1%

Histogram of lengths of the category

Length

Max length	1
Median length	1
Mean length	1
Min length	1

contributing_factor_vehicle_1
Categorical

HIGH CARDINALITY

Distinct	54
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Memory size	717.2 KiB

Unspecified	23818
Driver Inattention	23816
Following Too Closely	6350
Failure to Yield Right-of-Way	5650
Backing Unsafely	3878
Other values (49)	28284

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
Unspecified	23818	25.9%
Driver Inattention	23816	25.9%
Following Too Closely	6350	6.9%
Failure to Yield Right-of-Way	5650	6.2%
Backing Unsafely	3878	4.2%
Passing or Lane Usage Improper	3607	3.9%
Passing Too Closely	3474	3.8%
Other Vehicular	2788	3.0%
Unsafe Speed	2186	2.4%
Unsafe Lane Changing	2173	2.4%
Other values (44)	14056	15.3%

Frequencies of value counts

Unique

Unique	2 ?
Unique (%)	< 0.1%

Histogram of lengths of the category

Length

Max length	32
Median length	18
Mean length	17.51903133
Min length	5

contributing_factor_vehicle_2
Categorical

Distinct	44
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	717.2 KiB

Unspecified	58526
Distraction	25055
Other Vehicular	958
Following Too Closely	889
Limited	881
Other values (39)	5487

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
Unspecified	58526	63.8%
Distraction	25055	27.3%
Other Vehicular	958	1.0%
Following Too Closely	889	1.0%
Limited	881	1.0%
Bicyclist	802	0.9%
Road Rage	649	0.7%
Passing or Lane Usage Improper	579	0.6%
Failure to Yield Right-of-Way	506	0.6%
Passing Too Closely	439	0.5%
Other values (34)	2512	2.7%

Frequencies of value counts

Unique

Unique	4 ?
Unique (%)	< 0.1%

Histogram of lengths of the category

Length

Max length	32
Median length	11
Mean length	11.48012985
Min length	5

vehicle_type_code1
Categorical

Distinct	23
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	717.2 KiB

Sedan	42899
Station Wagon	32950
Taxi	3236
Pick-up Truck	2372
Box Truck	1804
Other values (18)	8535

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
Sedan	42899	46.7%
Station Wagon	32950	35.9%
Taxi	3236	3.5%
Pick-up Truck	2372	2.6%
Box Truck	1804	2.0%
Other	1335	1.5%
Bike	1260	1.4%
Bus	1050	1.1%
Motorcycle	838	0.9%
Unspecified	707	0.8%
Other values (13)	3345	3.6%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	22
Median length	5
Mean length	8.360647523
Min length	2

vehicle_type_code2
Categorical

Distinct	19
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	717.2 KiB

Sport Utility Vehicle	32950
Sedan	19009
Unspecified	16303
Station Wagon/Sport Utility Vehicle	12927
Bike	2113
Other values (14)	8494

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
Sport Utility Vehicle	32950	35.9%
Sedan	19009	20.7%
Unspecified	16303	17.8%
Station Wagon/Sport Utility Vehicle	12927	14.1%
Bike	2113	2.3%
Taxi	1542	1.7%
Other	1442	1.6%
Pick-up Truck	1415	1.5%
Box Truck	1335	1.5%
Bus	602	0.7%
Other values (9)	2158	2.4%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	35
Median length	20
Mean length	16.27900998
Min length	3

vehicle_type_code1_num
Real number (ℝ_≥0)

ZEROS

Distinct	23
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	1.468571615
Minimum	0
Maximum	22
Zeros	42899
Zeros (%)	46.7%
Memory size	717.2 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	1
Q3	1
95-th percentile	8
Maximum	22
Range	22
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	2.996837902
Coefficient of variation (CV)	2.040648117
Kurtosis	14.50865548
Mean	1.468571615
Median Absolute Deviation (MAD)	1
Skewness	3.569528408
Sum	134809
Variance	8.981037411
Monotocity	Not monotonic

Histogram with fixed size bins (bins=23)

Value	Count	Frequency (%)
0	42899	46.7%
1	32950	35.9%
2	3236	3.5%
3	2372	2.6%
4	1804	2.0%
5	1335	1.5%
6	1260	1.4%
7	1050	1.1%
8	838	0.9%
9	707	0.8%
Other values (13)	3345	3.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	42899	46.7%
1	32950	35.9%
2	3236	3.5%
3	2372	2.6%
4	1804	2.0%

Value	Count	Frequency (%)
22	88	0.1%
21	114	0.1%
20	124	0.1%
19	154	0.2%
18	156	0.2%

vehicle_type_code2_num
Real number (ℝ_≥0)

ZEROS

Distinct	19
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	1.964333958
Minimum	0
Maximum	20
Zeros	32950
Zeros (%)	35.9%
Memory size	717.2 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	1
Q3	3
95-th percentile	8
Maximum	20
Range	20
Interquartile range (IQR)	3

Descriptive statistics

Standard deviation	2.812686761
Coefficient of variation (CV)	1.431878092
Kurtosis	9.223237086
Mean	1.964333958
Median Absolute Deviation (MAD)	1
Skewness	2.707249657
Sum	180318
Variance	7.911206813
Monotocity	Not monotonic

Histogram with fixed size bins (bins=19)

Value	Count	Frequency (%)
0	32950	35.9%
1	19009	20.7%
2	16303	17.8%
3	12927	14.1%
6	2113	2.3%
5	1542	1.7%
7	1442	1.6%
8	1415	1.5%
9	1335	1.5%
10	602	0.7%
Other values (9)	2158	2.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	32950	35.9%
1	19009	20.7%
2	16303	17.8%
3	12927	14.1%
5	1542	1.7%

Value	Count	Frequency (%)
20	97	0.1%
19	137	0.1%
18	146	0.2%
16	182	0.2%
15	182	0.2%

day
Real number (ℝ_≥0)

Distinct	31
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	16.32389211
Minimum	1
Maximum	31
Zeros	0
Zeros (%)	0.0%
Memory size	717.2 KiB

Quantile statistics

Minimum	1
5-th percentile	2
Q1	8
median	17
Q3	24
95-th percentile	30
Maximum	31
Range	30
Interquartile range (IQR)	16

Descriptive statistics

Standard deviation	8.951941846
Coefficient of variation (CV)	0.5483950633
Kurtosis	-1.22013628
Mean	16.32389211
Median Absolute Deviation (MAD)	8
Skewness	-0.1230531982
Sum	1498468
Variance	80.13726281
Monotocity	Not monotonic

Histogram with fixed size bins (bins=31)

Value	Count	Frequency (%)
19	3531	3.8%
26	3453	3.8%
22	3367	3.7%
20	3350	3.6%
27	3346	3.6%
24	3327	3.6%
21	3288	3.6%
23	3285	3.6%
29	3268	3.6%
3	3253	3.5%
Other values (21)	58328	63.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	3014	3.3%
2	2938	3.2%
3	3253	3.5%
4	3053	3.3%
5	3034	3.3%

Value	Count	Frequency (%)
31	1940	2.1%
30	2997	3.3%
29	3268	3.6%
28	3204	3.5%
27	3346	3.6%

month
Real number (ℝ_≥0)

Distinct	11
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	7.012549566
Minimum	2
Maximum	12
Zeros	0
Zeros (%)	0.0%
Memory size	717.2 KiB

Quantile statistics

Minimum	2
5-th percentile	4
Q1	6
median	7
Q3	8
95-th percentile	9
Maximum	12
Range	10
Interquartile range (IQR)	2

Descriptive statistics

Standard deviation	1.820777322
Coefficient of variation (CV)	0.2596455546
Kurtosis	0.02298307966
Mean	7.012549566
Median Absolute Deviation (MAD)	1
Skewness	-0.2483054528
Sum	643724
Variance	3.315230055
Monotocity	Not monotonic

Histogram with fixed size bins (bins=11)

Value	Count	Frequency (%)
8	24821	27.0%
7	21728	23.7%
9	12004	13.1%
6	10699	11.7%
5	7839	8.5%
4	7137	7.8%
3	3771	4.1%
11	3250	3.5%
12	453	0.5%
10	50	0.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
2	44	< 0.1%
3	3771	4.1%
4	7137	7.8%
5	7839	8.5%
6	10699	11.7%

Value	Count	Frequency (%)
12	453	0.5%
11	3250	3.5%
10	50	0.1%
9	12004	13.1%
8	24821	27.0%

year
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	7
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	2019.377696
Minimum	2013
Maximum	2020
Zeros	0
Zeros (%)	0.0%
Memory size	717.2 KiB

Quantile statistics

Minimum	2013
5-th percentile	2017
Q1	2019
median	2020
Q3	2020
95-th percentile	2020
Maximum	2020
Range	7
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	0.7786008224
Coefficient of variation (CV)	0.0003855647331
Kurtosis	3.055579037
Mean	2019.377696
Median Absolute Deviation (MAD)	0
Skewness	-1.598626281
Sum	185370795
Variance	0.6062192406
Monotocity	Not monotonic

Histogram with fixed size bins (bins=7)

Value	Count	Frequency (%)
2020	45944	50.1%
2019	40209	43.8%
2017	5534	6.0%
2018	82	0.1%
2015	19	< 0.1%
2013	7	< 0.1%
2014	1	< 0.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
2013	7	< 0.1%
2014	1	< 0.1%
2015	19	< 0.1%
2017	5534	6.0%
2018	82	0.1%

Value	Count	Frequency (%)
2020	45944	50.1%
2019	40209	43.8%
2018	82	0.1%
2017	5534	6.0%
2015	19	< 0.1%

hour
Real number (ℝ_≥0)

ZEROS

Distinct	24
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	13.23760295
Minimum	0
Maximum	23
Zeros	3788
Zeros (%)	4.1%
Memory size	717.2 KiB

Quantile statistics

Minimum	0
5-th percentile	1
Q1	9
median	14
Q3	18
95-th percentile	22
Maximum	23
Range	23
Interquartile range (IQR)	9

Descriptive statistics

Standard deviation	5.968824943
Coefficient of variation (CV)	0.4508992276
Kurtosis	-0.4269631996
Mean	13.23760295
Median Absolute Deviation (MAD)	4
Skewness	-0.4995797965
Sum	1215159
Variance	35.6268712
Monotocity	Not monotonic

Histogram with fixed size bins (bins=24)

Value	Count	Frequency (%)
17	6539	7.1%
16	6444	7.0%
14	6196	6.7%
15	5768	6.3%
18	5675	6.2%
13	5527	6.0%
12	5068	5.5%
11	4615	5.0%
19	4526	4.9%
10	4253	4.6%
Other values (14)	37185	40.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	3788	4.1%
1	1864	2.0%
2	1434	1.6%
3	1225	1.3%
4	1154	1.3%

Value	Count	Frequency (%)
23	2889	3.1%
22	3355	3.7%
21	3630	4.0%
20	3935	4.3%
19	4526	4.9%

victim
Real number (ℝ_≥0)

HIGH CORRELATION
ZEROS

Distinct	14
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.3704518715
Minimum	0
Maximum	15
Zeros	66699
Zeros (%)	72.7%
Memory size	717.2 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	1
95-th percentile	2
Maximum	15
Range	15
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	0.7400402741
Coefficient of variation (CV)	1.997669147
Kurtosis	17.25114774
Mean	0.3704518715
Median Absolute Deviation (MAD)	0
Skewness	3.17639185
Sum	34006
Variance	0.5476596073
Monotocity	Not monotonic

Histogram with fixed size bins (bins=14)

Value	Count	Frequency (%)
0	66699	72.7%
1	19437	21.2%
2	3707	4.0%
3	1188	1.3%
4	465	0.5%
5	175	0.2%
6	68	0.1%
7	34	< 0.1%
8	12	< 0.1%
9	5	< 0.1%
Other values (4)	6	< 0.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	66699	72.7%
1	19437	21.2%
2	3707	4.0%
3	1188	1.3%
4	465	0.5%

Value	Count	Frequency (%)
15	1	< 0.1%
12	1	< 0.1%
11	2	< 0.1%
10	2	< 0.1%
9	5	< 0.1%

season
Categorical

Distinct	4
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	717.2 KiB

Summer	61719
Spring	21898
Fall	6175
Winter	2004

Frequencies
Length

Value	Count	Frequency (%)
Summer	61719	67.2%
Spring	21898	23.9%
Fall	6175	6.7%
Winter	2004	2.2%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	6
Median length	6
Mean length	5.865462547
Min length	4

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Cramér's V (φc)

Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.

Count
Matrix

First rows

	collision_id	crash_date	crash_time	borough	zip_code	latitude	longitude	location	on_street_name	number_of_persons_injured	number_of_pedestrians_injured	number_of_motorist_injured	contributing_factor_vehicle_1	contributing_factor_vehicle_2	vehicle_type_code1	vehicle_type_code2	vehicle_type_code1_num	vehicle_type_code2_num	day	month	year	hour	victim	season
0	4182249	2019-08-03	17:25	STATEN ISLAND	10307.0	40.501465	-74.245230	(40.501465, -74.24523)	SWINNERTON STREET	0	0	0	Unspecified	Unspecified	Station Wagon	Sport Utility Vehicle	1	0	3	8	2019	17	0	Summer
1	4201115	2019-09-07	0:36	STATEN ISLAND	10307.0	40.503310	-74.237465	(40.50331, -74.237465)	SPRAGUE AVENUE	0	0	0	Unsafe Speed	Unspecified	Station Wagon	Sport Utility Vehicle	1	0	7	9	2019	0	0	Summer
2	4198160	2019-08-17	15:00	STATEN ISLAND	10307.0	40.503387	-74.248830	(40.503387, -74.24883)	FINLAY STREET	0	0	0	Unspecified	Unspecified	Sedan	Unspecified	0	2	17	8	2019	15	0	Summer
3	3664377	2017-05-06	2:55	STATEN ISLAND	10307.0	40.503414	-74.244960	(40.503414, -74.24496)	Unspecified	0	0	0	Alcohol Involvement	Unspecified	Station Wagon	Sport Utility Vehicle	1	0	6	5	2017	2	0	Spring
4	4327159	2020-07-08	20:20	STATEN ISLAND	10307.0	40.504470	-74.243454	(40.50447, -74.243454)	HYLAN BOULEVARD	0	0	0	Failure to Yield Right-of-Way	Unspecified	Sedan	Sedan	0	1	8	7	2020	20	0	Summer
5	4326628	2020-07-06	17:00	STATEN ISLAND	10307.0	40.504482	-74.247270	(40.504482, -74.24727)	Unspecified	1	1	0	Unspecified	Unspecified	Station Wagon	Sport Utility Vehicle	1	0	6	7	2020	17	1	Summer
6	4167167	2019-07-09	12:50	STATEN ISLAND	10307.0	40.505527	-74.238190	(40.505527, -74.23819)	HYLAN BOULEVARD	2	0	2	Following Too Closely	Unspecified	Station Wagon	Sport Utility Vehicle	1	0	9	7	2019	12	2	Summer
7	4173987	2019-07-20	16:30	STATEN ISLAND	10307.0	40.506187	-74.234900	(40.506187, -74.2349)	HYLAN BOULEVARD	1	0	1	Failure to Yield Right-of-Way	Unspecified	Station Wagon	Sport Utility Vehicle	1	0	20	7	2019	16	1	Summer
8	4307254	2020-03-15	4:10	STATEN ISLAND	10307.0	40.506187	-74.234900	(40.506187, -74.2349)	JOLINE AVENUE	1	1	0	Driver Inattention	Distraction	Sedan	Unspecified	0	2	15	3	2020	4	1	Winter
9	4331848	2020-07-18	7:26	STATEN ISLAND	10307.0	40.506187	-74.234900	(40.506187, -74.2349)	HYLAN BOULEVARD	1	0	1	Driver Inattention	Distraction	Sedan	Unspecified	0	2	18	7	2020	7	1	Summer

Last rows

	collision_id	crash_date	crash_time	borough	zip_code	latitude	longitude	location	on_street_name	number_of_persons_injured	number_of_motorist_injured	contributing_factor_vehicle_1	contributing_factor_vehicle_2	vehicle_type_code1	vehicle_type_code2	vehicle_type_code1_num	vehicle_type_code2_num	day	month	year	hour	victim	season
91786	4338003	2020-08-13	7:55	BRONX	10471.0	40.910114	-73.898544	(40.910114, -73.898544)	Unspecified	0	0	Unspecified	Unspecified	Station Wagon	Sport Utility Vehicle	1	0	13	8	2020	7	0	Summer
91787	4348893	2020-09-14	15:04	BRONX	10471.0	40.910130	-73.903220	(40.91013, -73.90322)	WEST 261 STREET	0	0	Driver Inattention	Distraction	Sedan	Unspecified	0	2	14	9	2020	15	0	Summer
91788	4177187	2019-07-24	20:10	BRONX	10471.0	40.910130	-73.903220	(40.91013, -73.90322)	RIVERDALE AVENUE	0	0	Unspecified	Unspecified	Station Wagon	Sport Utility Vehicle	1	0	24	7	2019	20	0	Summer
91789	4344621	2020-09-04	1:51	BRONX	10471.0	40.910200	-73.896614	(40.9102, -73.896614)	WEST 262 STREET	2	2	Unspecified	Unspecified	Sedan	Other	0	7	4	9	2020	1	2	Summer
91790	4350721	2020-09-23	6:30	Unspecified	Unspecified	40.910320	-73.897640	(40.91032, -73.89764)	WEST 262 STREET	0	0	Unspecified	Unspecified	Sedan	Unspecified	0	2	23	9	2020	6	0	Fall
91791	4309078	2020-04-15	15:26	BRONX	10471.0	40.910320	-73.897640	(40.91032, -73.89764)	HUXLEY AVENUE	0	0	Driver Inattention	Distraction	Sedan	Unspecified	0	2	15	4	2020	15	0	Spring
91792	4176935	2019-07-24	17:03	BRONX	10471.0	40.910380	-73.896630	(40.91038, -73.89663)	Unspecified	0	0	Unspecified	Unspecified	Station Wagon	Sport Utility Vehicle	1	0	24	7	2019	17	0	Summer
91793	4346741	2020-09-11	3:30	BRONX	10471.0	40.912018	-73.900000	(40.912018, -73.9)	WEST 263 STREET	0	0	Unspecified	Unspecified	Sedan	Sedan	0	1	11	9	2020	3	0	Summer
91794	4170658	2019-07-15	10:17	BRONX	10471.0	40.912117	-73.902680	(40.912117, -73.90268)	Unspecified	0	0	Unspecified	Unspecified	Taxi	Unspecified	2	2	15	7	2019	10	0	Summer
91795	4315239	2020-05-22	23:55	BRONX	10471.0	40.912170	-73.900770	(40.91217, -73.90077)	Unspecified	0	0	Unsafe Speed	Unspecified	Station Wagon	Sport Utility Vehicle	1	0	22	5	2020	23	0	Spring

Overview

Variables

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Cramér's V (φc)

Missing values

Sample

First rows

Last rows